Multimodal Interaction with Speech, Gestures and Haptic Feedback in a Media Center Application
نویسندگان
چکیده
We demonstrate interaction with a multimodal media center application. Mobile phone-based interface includes speech and gesture input and haptic feedback. The setup resembles our long-term public pilot study, where a living room environment containing the application was constructed inside a local media museum allowing visitors to freely test the system.
منابع مشابه
Multimodal Media Center Interface Based on Speech, Gestures and Haptic Feedback
We present a multimodal media center interface based on speech input, gestures, and haptic feedback (hapticons). In addition, the application includes a zoomable context + focus GUI in tight combination with speech output. The resulting interface is designed for and evaluated with different user groups, including visually and physically impaired users. Finally, we present the key results from i...
متن کاملSpeech-based and multimodal media center for different user groups
We present a multimodal media center interface based on speech input, gestures, and haptic feedback. For special user groups, including visually and physically impaired users, the application features a zoomable context + focus GUI in tight combination with speech output and full speech-based control. These features have been developed in cooperation with representatives of the user groups. Eva...
متن کاملLearning Sounding gestures
Non-visual senses can be used in toys to enhance and enrich the play experience. Previous research has shown that – especially for young children developing sensory-motor skills – exploration and play are two tightly linked activities: everything is new and needs to be “studied”, and playful behaviors emerge from active exploration. The main idea of this paper is to provide a new approach in de...
متن کاملMultimodal Human-Machine Interaction for Service Robots in Home-Care Environments
This contribution focuses on multimodal interaction techniques for a mobile communication and assistance system on a robot platform. The system comprises of acoustic, visual and haptic input modalities. Feedback is given to the user by a graphical user interface and a speech synthesis system. By this, multimodal and natural communication with the robot system is possible.
متن کاملMultimodal feedback for the acquisition of small targets.
This paper examines how multimodal feedback assists small-target acquisition in graphical user interfaces. All combinations of three feedback modes are analysed: non-speech audio; tactile; and pseudo-haptic "sticky" feedback. The tactile conditions used stimulation through vibration (rather than force-feedback), and the sticky conditions were implemented by dynamically reconfiguring mouse contr...
متن کامل